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Abstract 

With the ever-increasing number of applications for mobile 
phones, we are more and more likely to be confronted with a 
problem of a separation from our environment when 
looking at our screen. It can be easily illustrated with a 
mobile game that uses the real world as a platform (a 
location-based mobile game). Typically, the player must stop 
to look at the screen to get information, which then can alter 
the dynamics of the gameplay. One solution is to incorporate 
this constraint into the design of the gameplay, but there are 
also other options to solve this disconnect issue. The 
FeelTact project proposes an innovative approach that does 
not use the screen as the primary output device. Instead, it 
concentrates on maximizing rich tactile feedback, as opposed 
to simple vibrations. The FeelTact device is a new type of 
tactile bracelet that will drive the information a player 
receives. The first FeelTact game is an audiotactile mobile 
game based on an urban navigation system. The results are 
quite promising (higher scores and pleasure) and show that 
it is possible to access a new tactile dimension that has been 
underused in the past. 
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Introduction 

The users of mobile applications are confronted with a 
problem that can easily be put in a nutshell, that is, the 
screen screens them from the outside world. There is a 
clear break with the environment at the moment when 
our eyes get set on it. In other words, there is a 
separation that people have to stop and watch their 
phone screen. It is not always a problem, but if we are 
engaged in a game (especially a location-based mobile 
game that uses the real world as a platform), it can be 
greatly detrimental to the concentration. In addition, it 
is not the only aspect of the difficulties you meet. 
Indeed, this activity is, besides, not very discreet. 

Generally, the screen remains the main output device. 



Sound is not used very much and vibrating is 
generally reserved to simple notifications. This is why 
we present an approach dealing with rich tactile 
feedback, which can be accompanied by sound. 

Related Work and Positioning 

Even though tactile feedback is not widespread 
among the majority of users, there is an important 
number of research programs on the subject: different 
applications, material configurations, and tactile 
feedback modes. 

The applications of these programs often concern the 
augmentation of graphic tactile interfaces for mobile 
screens[Yatani, 2009] or non-mobile ones [Foehrenbach, 
2009], and for navigation [Couture, 2006]. However, 
there are many other represented fields, for example: 
audiovisual [Kim, 2010], audio communication [Chang, 
2002], Braille communication without Braille cells 
[Vinh Dinh, 2010], pace control [Qian, 2011], remote 
touch [Prattichizzo, 2010], space awareness [Ferscha, 
2008], surgery[Font, 2004], virtual reality[Regenbrecht, 
2005], virtual keyboards [Brewster, 2007]. 

Material configurations offering tactile feedback are 
very numerous as well: a screen[Jansen, 2010] a mobile 
device such as a mobile phone [Yamauchi, 2009], an 
entry device such as a pen, a trackball, or a graphic 
tablet pen [Lecolinet, 2005], a dedicated accessory 
[Diepenmaat, 2006], a remote control [Tahir, 2008], a 
joystick [Howard, 2004], a glove [Zelek, 2003], a 
bracelet [Lee, 2010], a belt [Van Erp, 2006], a jacket 
[Ombrellaro, 2008], shoes [Turchet, 2010], a chair 
[Rehman, 2008], a blanket [Dijk, 2010]. 

Tactile feedback modes are also rather varied: 
vibrations[Sahami, 2008], Braille cells [Tahir, 2009], 
piezoelectric acuators[Levesque, 2010], a solenoid [Lee, 
2004], a speaker [Hashimoto, 2009], a force feedback 
device [Anastassova, 2010]. 
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The FeelTact project aims, for its part, at the creation of 
accessible solutions for the public at large, for a 
material cost that will not rise above a few dozens of 
euros. The first FeelTact application is a mobile game 
based on a bracelet into which four vibrating motors 
are embedded. The objective is to get better scores and 
more pleasure with tactile feedback compared with 
visual feedback. 

Approach: the FeelTact System 

Not only does the FeelTact system enable us to add the 
tactile dimension to numerous contents and 
applications, but it also allows us to conceive directly 
contents and applications mainly using rich tactile 
feedback. 

The use of touch rather than that of vision makes it 
possible not to have any confliction between our 
environment and the information received. Indeed, 
vision has already been globally monopolised to 
perceive our environment, whereas touch is much 
more available. Furthermore, tactile information can 
be received extremely discreetly. This information is 
then strictly personal inasmuch that I am always the 
only one to be able to touch what I touch, nobody else 
but me can feel it. Finally, tactile information can be 
viewed as a supplementary canal. In such cases of an 
important amount of information, touch reveals itself 
to be very efficient [Anastassova, 2010]. The first 
FeelTact game combines tactile and audio feedback. 

The FeelTact system (see table 1) is composed at the 
beginning of two existing elements: a main system (for 
example a mobile phone), which can be connected to a 
network. For the case exposed in the following section, 
it is a smartphone with satellite navigation system, 
compass, and Internet connection. An accessory 
offering rich tactile feedback has been added, using 
one or several forms of communication (tactile 
protocols) through applications corresponding to 
needs generally based on software and hardware 
infrastructures on the server. 

TABLE 1 COMPONENTS OF THE FEELTACT SYSTEM 
(IN ITALICS, EXISTING ELEMENTS) 



Accessory (bracelet) 


Tactile protocols 


Main system 


Mobile applications 


Network 


Infrastructures 



Our first accessory is a bracelet that is, small, easy to 
build, very discreet, and doesn't have to be held in a 
hand. This bracelet uses a part of the body that allows 
four contact areas. All the testers of the system have 
been able to feel the four areas separately. These four 
contact areas are stimulated with vibration motors. 



With fewer areas, it allows less communication 
possibilities (not enough for the awaited applications) 
and with more areas, it doesn't allow feeling them 
separately. 

Implementation: a Location-Based Mobile 
Game 

A game has been conceived to illustrate our approach 
with the FeelTact system, that is, a mobile game based 
on navigation mechanisms: a GPS for localization, a 
compass for direction, and indications concerning 
direction and distance. The game functions for the 
time on mobile phones of the iPhone type (from the 
3GS model). The aim of the game is to discover a letter 
from the alphabet, which has been drawn on a map 
(see figure 1). 




FIG. 1 EXAMPLE OF A LETTER (W) AND THE BEGINNING OF 
THE ROUTE TO DISCOVER IT (THE ARROW) 

To achieve that, the players must be on location and 
go to the place which corresponds to the first spot on 
the map and which has been indicated to them on a 
map on their smartphone screen (see figure 2). 
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FIG. 2 SCREENSHOT OF THE SELECTION OF THE GAME (LEFT) 
AND SCREENSHOT OF THE GAME (RIGHT) 
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During the game, the players feel the direction to take 
(tactile feedback) and the distance to walk to get to the 
following spot on the map (voice synthesis), and they 
don't have to look at their telephone screen. The latter 
is only used as a virtual two-key keyboard (see figure 
2): one to ask for help and one to quit the game. The 
Help button takes up practically all the space of the 
screen, so it is not necessary to look at it to activate this 
function. To quit the game, a confirmation is required. 

Here is the tactile protocol that we use: four vibration 
motors are active if the direction is correct, two on the 
left (or right) if the player has to turn slightly to the 
left (or right), and one on the left (or right) if the player 
has to really turn left (or right). It can be understood as 
the following: the more precise the tactile feedback is, 
the more the player has to turn. 

At the beginning of the game, the players are told the 
direction to take and the distance to walk to get to the 
following spot on the map. Direction is indicated under 
a tactile form by using the vibrating motors. The players 
must find the direction by moving their hand, which 
contributes to the fun of the game and to their 
implication in it. Distance is indicated by voice synthesis. 

After a few moments, direction indications stop and 
the players must go as far as the next spot. If they feel 
that finally they fail to head in the right direction, they 
can ask for help and new indications can be given to 
them. If there has serious difficulties in the game 
detection for the players (too far from the spots or too 
much time), automatic help will be switched on. 

When the players reach the spot, they are told about it 
in a tactile way and by voice synthesis. Then, the game 
indicates the next spot. At the moment, when the 
players reach the last spot, the game asks them what 
letter they are supposed to find. If they don't know, 
they can ask to see the itinerary they have taken. The 
score is calculated according to the time spent, the 
success or failure to find the letter, the number of tries, 
the use or not of the display of their itinerary, the 
number of aids they have asked for and that brought 
to them automatically. The score can be shared online 
and the players may then chose a new round of the 
game on the map. 

The settings of the game mechanisms are mostly based 
on the numerous tests we made, as well on existing 
results concerning non-visual navigation [Magnusson, 
2010] and indication of direction [Pielot, 2010]. 

Evaluation 

The evaluation of the project was made at different 



levels and moments. 

Before the game was developed, the hypothesis of 
tactile navigation has been validated in an urban 
environment. 

To that effect, the precision of the GPS and the 
compass were tested. It was concluded that the scale 
and minimum distance between each spot had to be 
about the size of a block. If one spot is placed on one 
side of a street and the other spot just opposite, there 
easily may be confusion between the two. Moreover, 
we had to determine a diameter of about 10 meters for 
the circular area corresponding to a spot (when 
conditions are good). Finally, it could be seen that it 
was necessary to avoid being near very tall buildings 
(the precisions of these tools becoming insufficient). 

Then the research of which direction to take was tested 
using the compass and the vibration mechanism 
described above. The results were quite good 
provided that the hand of the player was moved 
rather slowly. 

In the course of the elaboration of the different 
versions of the game, the quality of its gameplay was 
validated. To that effect, the work was based on the 
pleasures identified by Alain and Frederic Le Diberder 
[Le Diberder, 1998]: competition, achievement, 
mastery of a system, narration, spectacular aspect. 

Competition: what is at stake is very clear, and it is to 
be number one on the leaderboard. Achievement: it 
corresponds to the discovery of each letter. The 
mastery of a system: in this case, being able to go from 
one spot to another with two indications (tactile and 
sound indication). Narration: this game doesn't 
include a story, so we don't take this aspect into 
account for the moment, even if it remains an 
interesting possibility. Spectacular aspect: here we 
have a really stunning experience, that of playing a 
video game while being immerged in the place where 
you are, which can, itself, be spectacular. 

Once the game was developed, we had it tested by 
different complementary groups of people: students 
(used to playing video games), researchers (who knew 
what the project was about), and athletes (doing cross- 
country running or hiking). 

Before the beginning of the game, we gave general 
instructions. During the game, we followed the 
players to observe the various sequences of the game. 
And after the end of the game, we talked about it with 
the players. 

Thus, we collected information on the technical and 
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ergonomic aspects of the game, its comprehension, the 
strategies of the players, and the improvements they 
thought were necessary (see table 2). 

We had also tested a second version of the game, with 
visual feedback instead of tactile feedback. It allowed 
us to compare the common visual approach to the 
tactile one. 

We got two main results. 1. The scores were higher 
with the tactile feedback. 2. The comments of the 
players(collected from a questionnaire) showed a 
higher pleasure with the tactile feedback, mainly 
thanks to a higher immersion in the game 
environment (i.e. the town). 

These very positive results show that the use of rich 
tactile feedback makes it possible to obtain efficiently 
the indication of which direction to take in the context 
of a game of urban navigation. 



TABLE 2 COLLECTED INFORMATION 



Technical aspect 


A problem was noted several times. The 
compass was disturbed by metallic 
elements. 


Ergonomic aspect 


It was necessary to remind some of the 
players not to move the handset too 
quickly. 


Comprehension of 
the game 


It seemed that there was no ambiguity 
concerning its aims. 


Strategies 


Two strategies prevailed. Either to go fast 
and take the risk to make mistakes or to go 
slowly so as not to make mistakes. 


Necessary 
improvements 


Several players were asked for clearer oral 
indications to identify the different 
moments of the game. 



All this can be done without any separation from the 
environment. You can enjoy the setting of the places, 
and the aim is taken directly through your own eyes, 
possible dangers can be seen and avoided. 



Moreover, you can remain discreet. Only the 
movements of your hand while trying to find the 
direction to take can attract somebody else's attention. 
An alternative consists in turning slowly around if you 
wish to remain really discreet. 

Besides, nobody else receives the information. And 
finally, in this context, it can benoted that the sound 
feedback and tactile feedback are complementary 
easily. 

Discussion 

The evaluation of the approach proposed above has 
provided the opportunity to show its limits. To begin 



with, there are two technical limits. 

Firstly, the precision of the GPS restrains us 
concerning the scale of the game, and the game 
locations, causing some deadlocks due to some shifts 
(it is sometimes impossible to be localized on one 
particular spot). 

Secondly, the disturbances of the compass cause the 
system to send erroneous feedback. It would then be 
necessary to detect them and assist the player to get 
rid of them. 

In the field of assistance to the user, we could also 
detect when the movements of the hand are too rapid 
and do automatically what we did on location when 
the movement is shown to the users. 

Conclusion and Future Work 

The FeelTact project gives applications and digital 
content a tactile dimension that is sufficiently rich to 
be able, in some scenarios, not to use the screen as the 
main output device. It has shown itself to be 
particularly pertinent to mobile gaming. There is then 
no separation from the environment at the moment 
when the access to the information is available and it 
is done discreetly. 

Nobody else can perceive the information you get. 
And tactile information can be easily completed with 
other modes such as sound feedback. 

The experiment has allowed us to validate the 
approach and to foresee numerous developments. 
New scenarios and the fundamental aspect of the 
project: tactile protocols is the focus of further work. 

REFERENCES 

Anastassova, M. and Roselier, S. A Preliminary User 
Evaluation of Vibrational Patterns Transmitting Spatial 
Information. Proceedings of HaptiMap: Using Audio and 
Haptics for Delivering Spatial Information via Mobile 
Devices (Workshop in conjunction with ACM 
MobileHCI), Lisbon (Portugal), September 7-10, 2010. 

Brewster, S. A., Chohan, F., and Brown, L.M. Tactile 
Feedback for Mobile Interactions. Proceedings of the 
Conference on Human Factors in Computing Systems 
(CHI 2007), 159-162, San Jose (California, USA), April 
28-May 3, 2007. 

Chang, A., O'Modhrain, S., Jacob, R., Gunther, E., and Ishii, 
H. Comtouch: Design of a Vibrotactile Communication 



76 



Mobile Computing Vol. 2 Iss. 3, August 2013 



www.mc-journal.org 



Device. Proceedings of the 4th Conference on Designing 
Interactive Systems: Processes, Practices, Methods, and 
Techniques (DIS '02), 312-320, New York (USA), 2002. 
Couture, N. and Minel, S. TactiMod dirige et oriente un 
pieton. Actes des troisiemes journees francophones 
mobilite et ubiquite (Ubimob '06), 9-16, Paris (France), 
2006. 

Diepenmaat, P. neXus - Designing a Dedicated Mediascape 
Device. Master thesis, Delft University of Technology, 
Hewlett-Packard Laboratories Bristol, 2006. 

Dijk, E. O. and Weffers-Albu, A. Breathe with the Ocean: A 
System for Relaxation using Audio. Proceedings of 
Haptic and Visual Stimuli (Special Symposium at 
EuroHaptics 2010, Haptic and Audiovisual Stimuli: 
Enhancing Experiences and Interaction), 47-60, 
Amsterdam (Netherlands), July 7, 2010. 

Ferscha, A., Emsenhuber, B., Riener, A., Holzmann, C, 
Hechinger, M., Hochreiter, D., Franz, M., Zeidler, A., dos 
Santos Rocha, M., and Klein, C. Vibro-Tactile Space- 
Awareness. Proceedings of the 10th International 
Conference on Ubiquitous Computing (UbiComp 2008), 
Seoul (South Korea), 2008. 

Foehrenbach, S., Konig, W. A., Gerken, J., and Reiterer, H. 
Tactile Feedback Enhanced Hand Gesture Interaction at 
Large, High-Resolution Displays. Journal of Visual 
Languages and Computing, 20:341-351, 2009. 

Font, I., Weiland, S., Franken, M., Steinbuch, M., and Rovers, 
L. Haptic Feedback Designs in Teleoperation Systems for 
Minimal Invasive Surgery. Proceedings of the IEEE 
International Conference on Systems Man and 
Cybernetics (SMC 2004), 2513-2518, The Hague 
(Netherlands), October 10-13, 2004. 

Hashimoto, Y., Nakata, S., and Kajimoto, H. Novel Tactile 
Display for Emotional Tactile Experience. Proceedings of 
the 5th International Conference on Advances in 
Computer Entertainment Technology (ACE 2009), 124- 
131, Athens (Greece), October 29-31, 2009. 

Howard, D. M. and Rimell, S. Real-Time Gesture-Controlled 
Physical Modelling Music Synthesis with Tactile 
Feedback. EURASIP Journal on Advances in Signal 
Processing, 2004(7):1001-1006, 2004. 

Jansen, Y., Karrer, T., and Borchers, J. MudPad: Tactile 
Feedback and Haptic Texture Overlay for Touch Surfaces. 



Proceedings of the ACM International Conference on 
Interactive Tabletops and Surfaces (ITS '10), 11-14, New 
York (Etat de New York, USA), November, 2010. 

Kim, Y., Cha, J., Oakley, I., and Ryu, J. A Tactile Glove 
Designand Authoring System for Immersive Multimedia. 
IEEE MultiMedia, 17(3):34-44, 2010. 

Le Diberder, A. and Le Diberder, F. L'univers des jeux video. 
La decouverte, 1998. 

Lecolinet, E. and Mouret, G. TACTIBALL, TACTIPEN, 
TACTITAB - Ou comment « toucher du doigt » les 
donnees de son ordinateur. Proceedings of IHM 2005, 
227-230, 2005. 

Lee, J. C, Dietz, H, Leigh, D., Yerazunis, W. S., and Hudson, 
S. E. Haptic Pen: A Tactile Feedback Stylus for Touch 
Screens. Proceedings of the ACM Symposium on User 
Interface Software and Technology (UIST 2004), 291-294, 
October, 2004. 

Lee, S. C, Starner, T., and Shin, H. The Effect of Body 
Configuration and Heuristics in On-body Information 
Tactilization of Directional Patterns. Proceedings of 
HaptiMap: Using Audio and Haptics for Delivering 
Spatial Information via Mobile Devices (Workshop in 
conjunction with ACM MobileHCI), Lisbon (Portugal), 
September 7-10, 2010. 

Levesque, V. and Hayward, V. Laterotactile Rendering of 
Vector Graphics with the Stroke Pattern. Proceedings of 
Europhaptics 2010, 25-30, 2010. 

Magnusson, Ch., Rassmus-Grohn, K, and Szymczak, D. 
Show Me the Direction - How Accurate Does It Have to 
Be? Proceedings of Using Audio and Haptics for 
Delivering Spatial Information via Mobile Devices 
(Workshop at MobileHCI 2010), Lisbon (Portugal), 
September 7, 2010. 

Ombrellaro, M. P., Soto, B., Morris, A. L., Kelly, J. J., and 
Ombrellaro, A. Tactile Wearable Gaming Device. Patent 
US 2008/0153590 Al, 2008. 

Pielot, M. and Boll, S. "In Fifty Metres Turn Left": Why 
Turn-By-Turn Instructions Fail Pedestrians? Proceedings 
of Using Audio and Haptics for Delivering Spatial 
Information via Mobile Devices (Workshop at 
MobileHCI 2010), Lisbon (Portugal), September 7, 2010. 

Prattichizzo, D., Chinello, F., Pacchierotti, C, and 
Minamizawa, K. RemoTouch: A System for Remote 



77 



www.mc-journal.org 



Mobile Computing Vol. 2 Iss. 3, August 2013 



Touch Experience. Proceedings of the 19th IEEE 
International Symposium in Robot and Human 
Interactive Communication (Ro-Man 2010), 676-679, 
Viareggio (Italy), September 12-15, 2010. 

Qian, H., Kuber, R., Sears, A., and Murphy, E. Maintaining 
and Modifying Pace through Tactile and Multimodal 
Feedback. Interacting with Computers, 2011. 

Regenbrecht, H., Hauber, J., Schoenfelder, R., and 
Maegerlein, A. Virtual Reality Aided Assembly With 
Directional Vibro-Tactile Feedback. Proceedings of the 
3rd International Conference on Computer Graphics and 
Interactive Techniques in Australasia and South East 
Asia (GRAPHITE '05), 381-387, Dunedin (New Zealand), 
November 29-December 2, 2005. 

Rehman, S. and Liu, L. Vibrotactile Rendering of Human 
Emotions on the Manifold of Facial Expressions. Journal 
of Multimedia, 3(3):18-25, 2008. 

Sahami, A., Holleis, P., Schmidt, A., and Hakkila, J. Rich 
Tactile Output on Mobile Devices. Proceedings of the 
European Conference on Ambient intelligence, 210-221, 
Nuremberg (Germany), November 19-22, 2008. 

Tahir, M., Bailly, G., Guiard, Y., and Lecolinet, E. Tactile 
Assistance for Selecting List Favorites with a Bifocal 
Absolute and Relative Representation. Proceedings of 
13th Annual Conference on Human Computer 
Interaction (ChiNL 09), Leiden (Netherlands), June 11, 
2009. 

Tahir, M., Bailly, G., Lecolinet, E., and Mouret, G. TactiMote: 
A Tactile Remote Control for Navigating in Long Lists. 
Proceedings of the 10th International Conference on 
Multimodal Interfaces, 285-288, Chania (Greece), 
October 20-22, 2008. 

Turchet, L., Nordahl, R., Serafin, S., Berrezag, A., Dimitrov, 
S., and Hayward, V. Audio-Haptic Physically-Based 
Simulation of Walking on Different Grounds. 
Proceedings of the IEEE International Worshop on 
Multimedia Signal Processing (MMSP '10), 269-273, Saint 
Malo (France), October 4-6, 2010. 

Van Erp, J. B. F., Van Veen, H. A. H. C, Jansen, C, and 
Dobbins, T. Waypoint Navigation With a Vibrotactile 
Waist Belt. ACM Transactions on Applied Perception, 
2(2):106-117, 2006. 



Vinh Dinh, V., Van Phan, H, Xuan Tran, N, Ceruti, M. G., 
Ton, T.-A., and Duffy, L. Wireless Haptic Glove for 
Language and Information Transference. Patent US 2010/ 
0134327 Al, 2010. 

Yamauchi, T., Konyo, M., Okamoto, S., and Tadokoro, S. 
Virtual Active Touch: Perceived Roughness through a 
Pointing-Stick-Type Tactile Interface. Proceedings of the 
Third Joint Eurohaptics Symposium and Symposium on 
Haptic Interfaces for Virtual Environment and 
Teleoperator Systems (WorldHaptics '09), 605-610, Salt 
Lake City (France), 2009. 

Yatani, K. and Truong, K. N. SemFeel: A User Interface with 
Semantic Tactile Feedback for Mobile Touch-Screen 
Devices. Proceedings of the ACM Symposium on User 
Interface Software and Technology (UIST '09), 111-120, 
Victoria (Canada), October 4-7, 2009. 

Zelek, J. S., Bromley, S., Asmar, D., and Thompson, D. A 
Haptic Glove As a Tactile- Vision Sensory Substitution for 
Wayfinding. Journal of Visual Impairment, and 
Blindness, 97(10):621-632, 2003. 

Nicolas Esposito is an associate professor at the Universite 
de Technologie de Compiegne (UTC) in France. His courses 
and research are about digital production and video games. 
He created two courses at UTC: one about digital and photo 
production, the other about video games (industry and 
design). Previously, he was a research engineer at Dassault 
Systemes (software industry) and CNRS. He also co-founded 
the non profit organization RendezVousCreation and the 
video game development studio Many Players. He is a PhD 
and an engineer in computer science. Besides, he is the 
author of a book about emulation and video games and the 
designer of several video games. 

Charles Lenay was director of the Research Unit EA2223 
COSTECH (Knowledge, Organisation and Technical 
Systems) at UTC, Universite de Technologie de Compiegne 
(2004-2011). After serving as Vice-President of the French 
Association for Cognitive Research (ARCo), he created in 
1995 the Perceptive Supplementation Group (GSP) in the 
framework of this Research Unit. As a professor in 
Philosophy of Sciences (2005) his research interests 
concerned the question of cognitive technologies: how tools 
and technical devices participate in cognitive activity 
in the broad sense-reasoning, memory, perception, 
social interaction. For this he created a minimalist 
experimental paradigm allowing a dialogue between 
cognitive psychology and phenomenology. 



78 



